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X/^ • An Ingletonian polymatroid satisfies, in addition to the polymatroid axioms, the inequalities of 

On I Ingleton (Combin. Math. Appln., 1971). These inequalities are required for a polymatroid to be repre- 

sentable. It is has been an open question as to whether these inequalities are also sufficient. Representable 
polymatroids are of interest in their own right. They also have a strong connection to network coding. 
■ In particular, the problem of finding the linear network coding capacity region is equivalent to the 

characterization of all representable, entropic polymatroids. In this paper, we describe a new approach 
, to adhere two polymatroids together to produce a new polymatroid. Using this approach, we can construct 

> 



o 



o 

ON 

o 



a polymatroid that is not inside the minimal closed and convex cone containing all representable 



■ polymatroids. This polymatroid is proved to satisfy not only the Ingleton inequalities, but also the 

' recently reported inequalities of Dougherty, Freiling and Zeger. A direct consequence is that these 



inequalities are not sufficient to characterize representable polymatroids. 



- , , , I. INTRODUCTION 

X 

! The idea of network coding was first proposed in the seminal paper [1] as a means to increase 

achievable transmission throughput in data communications networks. In the traditional packet- 
switched routing approach, intermediate network nodes can only duplicate received packets and 
forward them to subsequent nodes. In contrast, network coding allows arbitrary computational 
data processing at intermediate nodes. For example, intermediate nodes may forward arbitrary 
linear combinations of several received packets. In the single source multicast scenario, network 
coding significantly increases maximal transmission throughput, and achieves the max-flow min- 
cut bound. It was subsequently proved [2] that linear network codes suffice to achieve maximal 
throughput for this case. 
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While the easily computable maximum flow (and associated minimum cut) determines the 
maximal attainable throughput in the single source scenario, this bound is not tight in general 
(multiple sources and multiple sinks). In [3], first steps were made to characterize transmission 
throughput for the general case via entropy functions (polymatroids whose ground set is a set 
of random variables, and whose rank function is Shannon entropy). Inner and outer bounds on 
throughput were obtained in this way. Using the same idea, an exact characterization of the 
set of all achievable throughputs was later obtained [4]. Analogous bounds for networks where 
intermediate nodes are restricted to use only linear codes were obtained in [5] via representable 
entropy functions. 

Unfortunately, these entropy function based characterizations are implicit in nature, since an 
explicit characterization of the set of all entropy functions is still missing. Characterization of this 
set is one of the major open problems in information theory. Similarly, the set of all representable 
entropy functions has no explicit characterization. Notably, this set is a subset of representable 
polymatroids, whose characterization is one of the major open problems in matroid theory. 

This lack of explicit, computable results could prompt one to question this approach based on 
entropy functions. Although it leads to attractive implicit characterizations, perhaps the difficulties 
that arise are somehow an artefact of the approach. One could therefore be tempted to seek 
simpler characterizations of transmission throughput that avoid the need to precisely know the 
set of entropy functions. For instance, [1] demonstrated that a much simpler characterization is 
possible in the single source scenario where the max-flow min-cut bound is tight. Unfortunately, 
a recent paper [6] disproved the existence of any simpler characterization for the general case. 
Using a specially contructed network, it was proved that if one can determine the set of all 
achievable throughputs in the special network, then one can also determine the set of all entropy 
functions (and vice-versa). Hence, determining achievable throughput for network coding is in 
general no simpler than determining the set of entropy functions. A similar duality was obtained 
in the same paper between the set of throughputs achieved by linear codes and the set of 
representable entropy functions. 

These results [3]-[6] indicate a very close tie between characterization of (representable) 
entropy functions and throughput achievable with (linear) network codes. Characterization of 
entropy functions is equivalent to finding all linear information inequalities that hold regardless of 
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the underlying joint distribution [3]. It is a well known result, extending back to Shannon [7] that 
entropy and mutual information are both nonnegative, correpsonding exactly to the polymatroid 
axioms. No further information inequalities were found for fifty years, until [8] reported the 
first "non-Shannon" information inequality. The significance of that result lay not only in the 
inequality itself, but also in its construction. This particular approach for construction has been the 
main ingredient in every non-Shannon inequality that has been subsequently discovered. Using 
this appraoch, new inequalities can be found mechanically [9] and there are in fact infinitely many 
such independent inequalities even when there are only four random variables involved [10]. 
Despite this progress, a complete characterization is still missing, and we still only have one 
basic approach for finding new inequalities. 

This situation does not improve for representable entropy functions. In addition to the poly- 
matroid inequalities, it is well known that representable entropy functions satisfy Ingleton's 
inequalities [11]. Specifically, let Wi, . . . , W4 be vector subspaces. Then 

< dim {Wi, W2) + dim {Wi, W3) + dim {Wi, W4) + dim {W2, W3) + dim {W2, W4,) 

- dim {Wi) - dim {W2) - dim {W^, W^) - dim {Wi, W2, W^) - dim {Wi, W2, W4) (1) 

where {Wi, Wj) is the minimal vector subspace containing WiUWj, and similar for {Wi, Wj, Wk). 
It has been an open problem since 1971 as to whether these inequalities are also sufficient as 
well as being necessary conditions for representability. 

Very recently, several new inequalities for representable polymatroids were reported at the 2009 
Workshop on Applications of Matroid Theory and Combinatorial Optimization to Information 
and Coding Theory [12 jl]. These inequalities were found by adapting the approach in [8], [9]. It 
was verified numerically that the newly obtained inequalities (which we shall refer to as DFZ 
inequalities) completely characterize representable entropy functions involving five variables (the 
Ingleton inequalities are already known to be sufficient for four variables). It is not known if 
these inequalities remain sufficient for more than five variables. 

The objective of this paper is to understand properties of representable entropy functions (and 
more generally, representable polymatroids). Our main contribution is a proof for the insufficiency 
of the Ingleton and DFZ inequalities for charcterization of representable polymatroids. 

'We became aware of this independent work during the preparation of early drafts of this manuscript. 
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Whereas [12] constructively proves the insufficiency of the Ingleton inequalities following the 
Zhang- Yeung approach [8], our approach is totally different. We construct a polymatroid which 
satisfies every Ingleton and DFZ inequality, but which is not contained within the minimal closed 
and convex cone containing all representable polymatroids. This directly establishes the existence 
of further, yet-to-be-discovered linear inequalities for representable polymatroids. 

The organization of the paper is as follows. In Section HIl we will introduce the required 
technical framework for the problem. Section HII] introduces a new method for constructing 
a polymatroid by adhering together any two Ingleton polymatroids. We will prove that the 
resulting polymatroids satisfy the Ingleton inequalities, and that this construction also preserves 
representability. In Section |Vl we will construct an Ingleton polymatroid by adhering two 
representable polymatroids together. This constructed polymatroid will be proved in Section 
ITVl to lie outside the closed and convex cone containing all representable polymatroids. This 
establishes the insufficiency of Ingleton's inequalities. Finally, in Section |Vll we prove that this 
constructed polymatroid also satisfies the DFZ inequalities (for five variables), demonstrating 
the insufficiency of the DFZ inequalities. 

The following notational conventions will be used. Set union will be denoted by concatenation; 
Singletons and sets with one element are not distinguished; Given X = {Xi,X2, . . . ,Xn} and 
any subset a of the finite index sej^ Afn = {1, 2, ... , n}, the subscript Xa will mean the set 
{Xi,i E a}. For C A/'„, Xap = X^Xj^ = Xa U Xp all refer to the same set. Similarly, 
for any A,BCX,AUB and AB are the same set. (S) will denote the minimal vector space 
spanned by S. We will use con(5) to denote the minimal convex cone containing the set S and 
con(iS) to denote the closure of con(iS). Finally, M, Z and are the reals, integers and a finite 
field on q elements. 

^If n is understood, the subscript may be dropped for simplicity. 
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II. Background 

A polymatroid over the ground set X = {Xi, X2, . . . , X„} is a tuple {X, h) where the rank 
function h : 2"^ 1— > ]R_|_ satisfies the following axioms for all A,B C X, 

h(0) = (Rl) 
ACB ^ h{A) < h{B) (R2) 
h{AuB)+h{AnB) <h{A) + h{B). (R3) 

A polymatroid {X,h) is called a matroid [13], if it further satisfies the cardinality bound, 
h(^) < 1^1 , and the integrality constraint h(^) G Z, for all A,B C X. 

For any A,B,CC X, define the generalized information expressions as follows: 

H{A\C) = h{AC) - h(C) (2) 

I{A;B\C) = h{AC) + h{BC) - h(C) - h{ABC). (3) 

when C = we write H{A) = h{A) and I{A] B) = H{A) - H{A \ B) (consistent with the 
above definitions). It is straightforward to prove that (X, h) is a polymatroid if and only if (IRll) 
holds and both ^ and ([3]) are nonnegative for all choices of A, B and C. 

Polymatroids arise in many different contexts. For example, let X = {Xi, . . . ,X„} be a set 
of random variables. This naturally induces a polymatroid {X, h) such that h(^) is the Shannon 
entropy H(A) of the subset of random variables in A. In this case, Q and ([3]) are merely the 
usual definitions for conditional entropy and mutual information, and (X, h) is a polymatroid due 
to the nonnegativity of (conditional) entropies and mutual information. We emphasise however 
that the definitions Q and ([3]) are made for arbitrary polymatroids (where the rank function may 
not induced by random variables). 

Polymatroids can also be induced by vector subspaces. Let X = (Xi, . . . ,X„) be a set of 
subspaces of a vector space W over a finite field ¥q. Define h(^) as the dimension of the 
minimal vector subspace containing all the subspaces in A, 

h{A) = dim{A) (4) 

Then {X, h) is also a polymatroid. These subspace induced polymatroids (called representable 
polymatroids) are of the main objects of interest in this paper. 
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According to definitions Q and ([3]) above, when h is defined as in dH), we can use H(A) to 
denote dim(^) for any set of vector subspaces A. Furthermore, the following lemma may be 
easily verified. 

Lemma 1: Let X = (Xi, . . . , X„) be a set of vector subspaces and A,BCA!. Then 

H{A\B) = dim{A, B) - dim(i3) (5) 
I{A]B) = ^im{{A)n{B)) (6) 

Furthermore, if 1^ = {A) n (S), then I{A]B\V) = 0. 
We shall classify polymatroids as follows. 

Definition 1 (Classification): A polymatroid (A", h), and associated rank function h, is called 

• q-representable if there exists vector subspaces {Vi, . . . , V^} over such that for all a C 
Mn, H{Xo) = dim(Va) as defined in ©. 

• representable if is g-representable for some q 

• even representable if is 2™-representable for some positive integer m 

• odd representable if is -representable for some odd prime p and a positive integer m 

• Ingletonian if it satisfies the Ingleton inequality JhiAi, A2, A3, A^j > for all subsets 

Ai, A2, A3, A4 C X where 

Jh (^1, A2, A3, A4) = h.{AiA2) + h(^i^3) + h(^i A) + HA2A3) + HA2A4) 

- h{Ai) - h{A2) - HA3A4) - h{AiA2A3) - h{AiA2A4). (7) 

According to [11], if a polymatroid {X,h) is representable, then it is also Ingletonian. A 
natural question then arises - Are the Ingleton inequalities sufficient to characterize representable 
polymatroids? In this paper, we will show that the answer to this question is negative. 

Following the framework for information inequalities presented in [14], it is useful to treat a 
rank function as a vector or point in a 2l'^l-dimensional real Euclidean space whose coordinates 
are indexed by the power set of X. Thus a point h G M^ '*' is specified by its coordinates as 
h = (h(^) : A C X). While a polymatroid is defined by a ground set and a rank function, 
the ground set is actually implicitly defined by the rank function. Hence, strictly speaking, a 
polymatroid (X, h) is no more than a rank function that satisfies the polymatroidal axioms. 
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In other words, a polymatroid is merely a point in an Euclidean space and characterization of 
representable polymatroids is equivalent to characterizing those points induced by representable 
polymatroids. 

Regarding polymatroids as points in M^''*' permits us to define metrics and limits on the set of 
polymatroids. Let T^[A:'] be the set of all g-representable rank functions and T[X] = T'gl'^]) 
be the set of all representable rank functions. 

Definition 2: A polymatroid {X, h) (and the corresponding rank function h) is called almost 
representable if there exists a sequence of representable rank functions {gijj^i and a sequence of 
positive numbers q such that h = hmj^oo Cjgi. On the other hand, h is called cc-representabl^ 
if h e con(T[A']). 

A linear inequality involving polymatroids is merely a linear inequality over M^''*'. We are 
interested to determine necessary conditions (linear inequalities in particular) on the rank function 
h under which it is representable. In this paper, complete characterization of representable rank 
functions means an explicit determination of con(T[A:']) or the set of linear inequalities satisfied 
by points in con(T[A:']). The following proposition may be directly verified. 

Proposition 1: A linear inequality J^i'^iHiA) > holds for all representable polymatroids 
(i.e. is a valid subspace rank inequality) if and only if J2i Cih{A) > for all h G con(T[A:']). 

III. Creating new polymatroids 

We now propose an approach to perturb an Ingletonian polymatroid in a way that preserves the 
Ingletonian property. This is achieved by Theorem \\\ We shall subsequently show in Theorems |2] 
and [3] that this perturbation also preserves (almost) representability. In Section |IVl we will 
use this approach to perturb a member of con(T[A']), taking it outside of con(T[A:']). This 
perturbed polymatroid will be used to show the existence of new subspace rank inequalities for 
representable polymatroids. 

Theorem 1 (e-pertubation): Let (3^, h) be an Ingletonian polymatroid. Let < e < h(3^) and 
define for all ^ C 3; 

g(^)^min(h(^),h(3;)-e). (8) 



' "cc" is a mnemonic for "Closed and Convex cone", 
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Then (3^, g) is also an Inlgetonian polymatroid. 



Proof: We need to prove that 



^g(Vl,V2,V3,V4) >0 



(9) 



for all V] 



. . . , V4 C 3^. To simplify notation, define 



(Vl, V2, V3, V4) ^ g(VlV2) + g(VlV3) + g(VlV4) + g(V2V3) + g(V2V4) 
J. (Vl, V2, V3, V4) = g(Vl) + g(V2) + g(V3V4) + g(VlV2V3) + g(VlV2V4). 



With these definitions, the Ingleton inequality ^ is written 



4 (Vl, V2, V3, V4) > j„- (Vl, V2, V3, V4) . 



(10) 



It is straightforward to prove that (3^, g) is a polymatroid. We must additionally show that it is 
Ingletonian. Let 



be the collection of a C A/4 such that the summand g(Vi, i G a) appears in J+ (Vi, V2, V3, V4). 
Let Q = {a <^ A/4 : h(3^) — e < h(Vj,i G a)}. Thus Q identifies summands in J+ and for 
which the e-perturbation in ([8]) bites. Note that if a G then g(Vj,i G a) > g(Vi,i G (3) for 
all 13 C A^. 

We will now proceed on a case-by-case basis, proving that ^ holds in the following distinct 
and exhaustive cases. 

Case 1: g n f/ = 0. 

Inequality Q clearly holds and follows from the fact that (3^, h) is Ingletonian, J+ = and 
< in- 
case 2: gnf/ = {(1,2)}. 

In this case, h(ViV2) > h(3^) — e. By monotonicity of polymatroids (IR2|) . h(ViV2V3) > 
h(3^) — e. The left hand side of (flOl) thus becomes 



[/ = {(1,2), (1,3), (2,3), (1,4), (2,4)}. 



(Vl, V2, V3, V4) = (Vl, V2, V3, V4) - h(ViV2) + h(3^) - e. 



Similarly, its right hand side can be shown to be bounded above by 



J. (Vl, V2, V3, V4) = Jh (Vl, V2, V3, V4) - h(ViV2V3) + h(3^) - e. 
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Thus ^ holds, since (3^, h) is Ingletonian and h(ViV2) < h(ViV2V3). A similar approach may 
be used when Q n U is any one of (1, 3), (1, 4), (2, 3) or (2, 4). 

Case 3: QnU = {(1, 3), (2, 3)}. 

As g is a polymatroid, g(ViV2) + g(ViV4) + g(V2V4) > g(Vi) + g(V2) + g(ViV2V4) and 
hence © holds as g(ViV3) + g(V2V3) = 2g(3^) > g(V3V4) + g(ViV2V3). Similarly, © holds if 

gnf/ = {(i,4),(2,4)}. 

Case 4:QnU = {(1, 2), (1, 3)}. 

Again, g(V2V3) + g(ViV4) + g(V2V4) > g(Vi) +g(V2) + g(V3V4) and consequently dH) holds 
because g is a polymatroid. Using the same argument, ^ also holds when Q D U is either 

{(1,2),(1,4)}, {(l,2),(2,3)}or{(l,2),(2,4)}. 

Case 5:QnU = {(1, 3), (2, 4)}. 

Now g is a polymatroid and hence g(ViV2)+g(V2V3)+g(ViV4) > g(Vi)+g(V2)+g(ViV2V3). 
Consequently, dH) holds as in the previous case. Similarly, Q holds when QCiU = {(1,4), (2, 3)}. 

Case 6:QnU = {(1, 3), (1, 4)}. 

In this case, © holds because g(ViV2) + g(V2V3) + g(V2V4) > g(Vi) + g(V2) + g(V2V3V4). 
Case 7: |g n f/| = 3 and g n t/ = {(1, 2), (2, 3), (2, 4)}. 

Inequality ^ follows from 

g(ViV3) + g(ViV4) > g(Vi) + g(ViV3V4) 
>g(Vi)+g(V3V4). 

A similar approach can be used for other cases when \Q nU] > 3. ■ 

In Theorem [H we proved that the e-perturbation of an Ingletonian polymatroid is also Ingle- 
tonian. Theorem [2] shows that e-perturbation also preserves representability. 

Theorem 2: Suppose {X, h) is representable and let {X, g^) be its e-perturbation ([8]). Then 
{X, ge) is almost representable for any < e < h{X). It is also representable if e G Z. 

Before we prove Theorem [21 we require some basic results regarding vector subspaces. Let A 
be a vector subspace of W. Define A* as a subspace of W such that 
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1) (A, A*) = W, and hence H{A, A*) = H{W) 

2) AnA* = {0}. 

Clearly, any vector u G W can be written uniquely as u = ui + U2 where ui G A* and U2 G A. 
We will refer to ui = Ta{u) as the projection of u away from A. While Ta{u) depends on the 
choice of A*, it can be directly verified that the following lemma holds for all legitimate choices 
of A*. 

Lemma 2: Let B and C be subspaces of W . Then for any subspace A of W , 

Ta{B) ^ {Ta{u) : u G S} 

is a subspace of W. Furthermore, 

H {Ta{B)) = H {B \ A) , (11) 
H{Ta{{B,,3 G m = H{Ta{B,),j G (3) . (12) 

Consequently, 

1) H {B„j e(3)>H {Ta{B,),j e/3)>H {B„j e P) - H (A) 

2) lfH{B\C) = (i.e. B C C), then H {Ta{B) \ Ta{C)) = 0. More generally, if H{B\Ci,ie 
0, then iJ(TA(5) | TA{Ci),i Ea) =0. 

3) If Bf] A = {0} (i.e. / {A; B) = 0), then H (B) = H {Ta{B)). 

The projection operator Ta(-) has a natural interpretation. Specifically, let {Xi, . . . , X„, A} be a 
collection of subspaces in W, which induces a representable polymatroid in the usual way. By 
Lemma [21 there exists subspaces {Bi, . . . , of W such that Bi = TA^Xi) and 

if G a) = (X„i G a I A) . (13) 

In other words, using the projection operator Ta{ ), one can transform any set of subspaces 
{Xi, . . . , X„} into another set {Bi, . . . , B^} such that H {B^, i e a) = H{Xi, i G a\A). Proof: 
[Proof of Theorem O Suppose (X, h) is representable. If h(A') = 0, then the theorem is trivial. 
Now suppose h(X) > and hence h{X) > 1 (since it is the dimension of a space). We begin by 
proving that {X, g^) is representable (and hence almost representable) when e = 1. The argument 
will subsequently be extended to cover other values of e. 
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First, as (X, h) is representable, there exists subspaces Vi, i E J\f such that 

h(Xi, iea) = H{Vi, iea) = dim{V„ i e a). (14) 

Assume without loss of generality that these subspaces are over an underlying field F^. For any 
positive integer m, Fg can be regarded as a subfield of F^m. In fact, for each i, let V^/"*^ be the 
subspaces over F^m spanned by Vi. Then 

dimCl//"\i ea) = dim{Vi,i E a) (15) 

or equivalently, H{v}"^\i E a) = H{Vi,i E a). 

Let C = HiVu) and g = {a C AT : HiV^) < C}. Then for each aEQ, 

if(v;(™)) = ij(v;) <c-i. 

The volume (i.e. cardinality) of {vl;'^\i E a) is at most (g"')*""^ while the volume of (y^'^\i E 
J\f) is (g™)'^. Hence, for sufficiently large m, IJagQ is a proper subset of G A/"). 

Let u E {V}"'\i E TV) but not in [J^^q Let A = (u) and define 

B,^Ta{vI"'^). (16) 

By Lemma[2l it is straightforward to prove that ge(a) = H{Bi, i E a). Hence, is representable. 
Repeating the same argument multiple times, we can also prove that the theorem also holds when 
e is a positive integer. 

Now, suppose e = k/£ is rational. For any representable {X,h), it is easy to find another 
representable (X, f ) such that f = ih. Consequently 

g,(^) = min(h(^), h{X) - k/i) (17) 

= J mm{ih{A),ih{Z) - k) (18) 

= ^min(f(^),f(A')-A;). (19) 

is almost representable. 

Finally, the remaining case when e is irrational can be proved by a continuity argument. 
Specifically, let vj be a sequence of rational numbers converging to e, then it is easy to prove 
that limj_>oog!/ = ge- Hence, g^ is almost representable. ■ 
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The final result of this Section, Theorem[3]is a direct consequence of the following proposition. 



Proposition 2: Let {(A*, hj)}^]^ be a sequence of representable polymatroids such that linij^oo Qhj = 
ho for some positive sequence of numbers {c,}^]^. Suppose < e < ho(A'). For each i, define 

g,(^) ^ min(Qh,(^), c,h,(A') - e) (20) 
go(^) ^ min(ho(^), ho(A') - e). (21) 

Then limj^oo gi = go and go is almost representable. 

Proof: If e = ho(A'), then the proposition is obvious. Now, suppose e < ho(A'). By the 
continuity of min(a, 6), 

lim (min (cjhi(w4), Cihi(A') — e)) = min ( lim Cihj(^), lim Cihi(A') — e) 

and hence limi_,oo gi = go- 
On the other hand, since limj^ooQhj = ho and < e < ho (A"), we have for sufficiently 
large % that < e < Cj\\i{^X) or equivalently < c/q < hj(A'). As h^ is representable, gj/Q 
and hence gj are almost representable by Theorem |2l Consequently, its limit go is also almost 
representable. ■ 

Theorem 3: Suppose (A", h) is almost representable. Let {X, g) be its e-perturbed polymatroid 
as defined in ([8]). Then g is almost representable. 



IV. Main results 

The main result of this paper is the following theorem, which is a direct consequence of 
Theorem [51 which we prove in this section, and Theorem [6] in the following section (which 
establishes the existence of certain matroids required for Theorem [5]). 

Theorem 4 (Insufficiency of Ingleton's inequalities): There exists an Ingletonian polymatroid 
that is not cc-representable. Consequently, there are linear inequalities satisfied by all repre- 
sentable polymatroids but not implied by Ingleton's inequalities. 

So far, we have defined the concept of e-perturbation and proved that it preserves both 
the Ingletonian property and representability. We will now use e-perturbation to construct an 
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Ingletonian polymatroid that is not cc-representable. First, we will need to establish a key lemma 
concerning connected matroids [13, Chapter 4]. 

Definition 3 (Connected Matroid): A matroid is connected if for any pair of Xi and 

X2 in X, there exists a circuit contains both Xi and X2. 

Definition 4: Let M = {X, h) be a matroid. Define I(M) as the set of equalities of the forms 
H{A\B)=Oor I{A;B) = satisfied by M. 

Lemma 3: If a matroid M = {X, h) is connected and (X, g) is any polymatroid that satisfies 
the set of I{M) equalities induced by M, then g(Xj) is constant for all X^ e X and g = ch 
for some c > 0. 

Proof: Suppose Xi,X2 belong to a circuit in the matroid M. Then there exists a subset 
of variables A such that 

i/(Xi|X2,^) = HiX2\X^,A) = IiX,;A) = /(Xs;^) = (22) 

where (|22l) is with respect to h. By assumption, g satisfies I{M), which includes (f22)) . It is 
easy to prove that if {X,g) is a polymatroid also satisfying (l22l) . then g(Xi) = g(X2). By the 
connectedness of M, g(Xj) is constant for all Xj G Af. 

Now, let B be any subset of X. Since (.Y, h) is a matroid, there exists A C B such that 
h(i3|^) = and h(^) = ^ -5^.^^ h(Xj), and these identities belong to X{M). By assumption, 
(A',g) also satisfies J(M), and hence z{B\A) = and g(^) = Ejf,e^g(^»)- Thus h(i3) = 
|^|h(X,)andg(S) = |^|g(X,). ■ 

The main result of this paper hinges on the following theorem. It describes an approach 
to adhere two representable matroids together in such a way that the resulting polymatroid is 
not cc-representable. We establish this theorem for connected matroids that are even (and odd) 
representable but not almost odd (even) representable. The existence of such strictly even and 
strictly odd matroids will be established in Theorem [6l Together with Theorem [51 this provides 
the proof of Theorem HI namely the insufficiency of the Ingleton inequalities . 

Theorem 5: Let {Xi, $1) (and {X2, $2)) be an even (and odd) connected representable matroid 
that is not almost odd (almost even) representable. Let {X, $) be the direct sum of these two 
matroids, namely X = X1UX2 and $(^) = ^i{AnXi) + $2(^n ^"2) for all AC X. Suppose 
< e < min($i(A'i), $2('^2))- Then {X, $') is not cc-representable. 
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Proof: By definition of e-perturbation ([8]), it is easily verified tliat 

^\A) = ^i{A), V^CAfi (23) 

= $2(i3), Vi3 C A'a. (24) 

Hence, satisfies all the equalities X(Mi) and J(M2). 

Suppose to the contrary that G con(T[A:']). Then by definition there exists a sequence of 
points hj G con(T[A']) such that linij^oo hj = $^ As each hj is a point in a 2' ■^'-dimensional 
Euclidean space, Caratheodory's theorem allows each h, to be written 

21-^1+1 

hi = ^ Qjfij (25) 

where Cjj > and dijiij is representable for some dij > 0. 

Assume without loss of generality that hi{X) = = ^""{X) for all Then all fij are 

contained in the compact set {f G M^'^' : < f (^) < ^'{X) for all A C X} and Ej=i'^^ = 
1 (and hence < Cij < 1). According to the Bolzano-Weierstrass theorem, any bounded sequence 
in a finite dimensional Euclidean space has a convergent subsequence. We may therefore assume 
without loss of generality the existence of the following limits for any j = 1, . . . , 2l'^l + 1 

lim Cj j = Cj 

lim fj j = fj. 

j— >oo ' 

Hence $^ = E?=i^^Cjf;-. 

As each f, is the limit of a sequence of polymatroids {fi,j}^i, {'^i^j) is also a polymatroid 
for all j. Therefore, {X,ij) also satisfies equalities X(Mi) and X(M2). On the other hand, as 
e > 0, $'(A'i) + $'(A:'2) > $'(^), there is at least one j such that 

f,(^l)+f,(A'2)>f,(A'). 

Consequently, both fj(A:'i) and ij{X2) are positive as fj is a polymatroid. Furthermore, since 
{Xi^ $i) and (^"2, $2) are connected matroids, by Lemma[3l there exists positive constants c and 



d such that 

f,.(^) = C$1 (^), C A"!, (26) 

f,(S) = c'$2(i3), C ^"2. (27) 
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So far, we have proved that if G con(T[A:']), then there exists a sequence of polymatroids 
{{X, ^^ch that (1) dijiij is representable for some dij > 0, and (2) its limit satisfies 

(|26l ) and dTT] ). We may further assume without loss of generality that dijiij is either even 
representable or odd representable for all i. Suppose first that all dijiij are even representable 
for all i. The fact that limj^oo fijl-B) = ij{B) = c'$2('B) thus implies that (A", $2) is almost 
even representable, contradicting the hypothesis. Similarly, contradiction occurs if dijiij are odd 
representable for all i. Contradiction occurs in both cases and hence the theorem is proved. ■ 

V. Strictly Odd and Even Matroids 

In this section, we will construct two representable matroids {Xi, $1) and {X2, $2) that satisfy 
the conditions given in Theorem [51 These matroids correspond to the first and second networks 
in [15, Section II]. 

Define the matroid {Xi, $1) with $i(-) = dim(-) and ground set 



^ {Fi, Y2, Y3, Wi, W2, W3, W,} (28) 

r, = (u,),z = 1,2,3 (29) 

TVi = (ui + U2) (30) 

W2 = {n2 + u;) (31) 

W3 = (ui + U2 + U3) (32) 

W^ = {m + us). (33) 



where Ui, U2, U3 are linearly independent vectors over a finite field of even characteristic. Clearly 
{Xi, $1) is even representable (and hence Ingletonian). In fact, this is the Fano matroid, F7. 
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Define the second matroid (^'2, $2) with $2(') = dim(-) and 



X2 — {Zi, . . . , Z5, Vi, . . . , Vg}, 


(34) 


Zi = (uj), i = 1, . . . ,5 


(35) 


Vi = (Ui + U2 + U3) 


(36) 


V2 = (U3 + U4 + U5) 


(37) 


V3 = (Ui + U2) 


(38) 


Va = (ui + U3) 


(39) 


V's = (U2 + U3) 


(40) 


Vq = (us + U4) 


(41) 


V7 = (U3 + U5) 


(42) 


Vg = (U4 + U5) 


(43) 



where {ui,...U5} are linearly independent over a finite field of odd characteristic. Clearly 
(Xi, $1) is odd representable (and hence Ingletonian). 

It is easy to prove that (A'i,$i) and (^"2, $2) are both connected. Furthermore, 

satisfies the following equalities (recalling the notational conventions Q, ([3])) 

3 

H{Yr,Y2,Y3) = J2H{Y^ (44) 

i=l 

H (Wi I Y1Y2) =0 H{W2\ Y2Y3) = (45) 

H {W3 I Y1W2) =0 H{W4\ W1W2) = 

H (Yi I 1^31^4) =0 H{Y2\ W3W4) = 

H{Y3 I W1W3) = 

It is worth pointing out explicitly that H {W4 \ W1W2) = because all vectors are defined over 
a finite field of even characteristic (hence, ui + U3 = ui + U2 + U2 + U3). 

Simiarly, (A:2,$2) satisfies 

5 

H{Zu...,Z,) = J2h{Z,) (46) 

i=l 
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H{V,\Z^Z2Zs) = 



H{V2\Z,Z,Z,)=0 



(47) 



H{Vs\Z,Z2) = 



H{V,\Z,Z,)=0 



H{V,\Z2Zs) = 



H{Ve\Z:,Z^)=0 



H{Vr\ZsZ,) = 



H{Vs\Z,Z,)=0 



HiZ^\V^V,) = 



H{Z2\ViVi)=0 



H{Zs\ViVs) = 



H{Zs\Vs,...,Vs)=0 



H{Zs\V2V8) = 



H{Zi\V2Vr) = 



H{Z,\V2Ve) = 0. 



In this case, we emphasis that H{Z3\V3, . . . ,Vs) = holds because the characteristic of the 
underlying field is odd. 

Theorem 6: {X, $i) defined by (l28l) is even representable but not almost odd representable. 
Simiarly, (X, $2) defined by (|34l) is odd representable but not almost even representable. 

Before we prove Theorem [6l we will need two lemmas, which provide some elementary results 
from linear algebra. 

Lemma 4: Let {Bi, . . . , Bn} and C be subspaces of W. Then for any a C J\f, there exists 
a subspace A such that H (A) = H [C \ B^J G a) and H {Ta{C) \ TA{Bj),j e a) = 0. 
Furthermore, for a given sequence of subspaces {B\, . . . , Bl^, C^}'^i and k{i) > such that 



Proof: It is easy to pick a subspace A of C such that H{A) = H{C \ Bj,j G a) and 
that A and {Bj,j G a) together span {C,Bj,j G a). Then it is straightforward to prove that 
H{Ta{C) I TA{Bj),j G a) = 0, which proves the first part of the lemma. 
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Similarly, for each i, there exists a subspace such that if (A*) = if(C* | Bj,j E a), and 
H{TA^{C^) I TA^iBi),j ea)=0. By Lemma H for any p 

H {bD - H {A') < H [Ta (5;) , J G /3) < [bD . (48) 

The remaining part of the lemma then follows as limj_,oo 'i^H^A^) = 0. ■ 

Lemma 5: Let . . . , i?„} be a collection of subspaces and (3 <^ M. Then there exists a 
subspace A such that 

if {Ta (B,)) = H [B, I Bp\,) , Vj G /?, (49) 

ii (T^ (5,) ,jeP) = J2H{TA (B,)) , (50) 

ie/3 

H{A)=H (Bp) -J2h [B, I Bp\,) . (51) 

ie/3 

Furthermore, for a sequence of subspaces {B\^ . . . , i?^}^i and A;(i) > such that 

lim 



k 



ie/3 

there exists a sequence of subspaces A* such that for all a C A/", 

5^ ii (T^. (i?i)) = ii (T^. (5;.) , J G /?) 

lim -^ii (T^. (5;) , J G «) = lim -i^ii (i?^) . 

Proof: Define A as the minimal subspace containing Bi fl (i?j, j E P \ i) for i E p. 
Then it is straightforward to prove that for all i, A is a subspace of {Bj,j E P \ i) and hence 

H{A\Bj,j E P\i) = 0. Similarly, for all i, BinA = BiH {Bj,j E P\i) and hence I{B,; A) = 
I{Bi-Bj,j EP\t) and 

n 

H{B,,...,Bn\A) = Y,HiB,\A)=H{B,\ Bp\,) 

i=l 

Consequently, (|49l)-(l5TI) holds. The remaining part of the lemma be proved similarly as in Lemma 
gl ■ 

The final ingredients that we require are the following results from [15]. Although these results 
were originally stated in terms of linear network coding capacity, we can restate them purely in 
terms of rank inequalities as follows. 
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Theorem 7 (Dougherty, Freiling, Zeger): Suppose that Xi = {Yi, F2, ^3, W^i, • • • , ^^4} is a 
collection of vector subspaces over a finite field of odd characteristic. If the resulting polymatroid 
satisfies dSl) and ([45]), then [15, Theorem IV.3] 

min^=i,2,3g(y^) ^ 4 
maxj=i,2,3,4-f^(W^j) ~ 5' 

Similarly, suppose that X2 = {Zi, . . . , Z5, Vi, . . . , Vs} is a collection of vector subspaces over a 
finite field of even characteristic. If X2 satisfies (|46|) and (|471) . then [15, Theorem IV. 4] 

minimi,.. .^5 H{Zi) ^ 10 
maxj=i^...^8 if(l^) ~ 11 
Proof: [Proof of Theorem [6l Suppose to the contrary that {X, $2) is almost even repre- 
sentable. Then by definition there exists a sequence of even representable polymatroids {{X, gj)}^ 
and positive constants rfj such that limj^oo digi = $2- While (X, $2) satisfies (l46l) and (l47l) . these 
constraints may not be satisfied by {X, gj) in general. However, we can use Lemmas |4] and [5] to 
construct from {{X,gi)}°Zi another sequence of even representable polymatroids {{X,g'^}fZi 
such that g^ satisfies (l46l) and (l47l) . and limj^oo c^igi = limj^ooC^igj = $2- As such, 

minfc=i,...,5g^(Zfc) ^ minj=i,...,5 'l>2(^fc) (a) ^ ^^2) 
j^oo maxfc=i,...,8g-(Vfc) maxfc=i,...,8 $2(Vfc) 
where (a) follows from connectivity of (X, $2). The existence of such a sequence {{X, dig'^}"^-^ 
contradicts Theorem |7] which proved that the limit (|52l ) is bounded above by 10/11. Thus (X, $2) 
cannot be almost even representable. Using the same argument, we can also prove that (X, $1) 
is not almost odd representable. ■ 



VI. Insufficiency of All Known Rank Inequalities 

In Section Uni we constructed (A", $) e con(T[A']) such that its e-pertubation {X,^") ^ 
con(T[A:']). Theorem [U proved the existence of new subspace rank inequalities that are not 
implied by Ingleton's inequalities. This was achieved by showing that (X, is Ingletonian. In 
the following, we will give another proof for Theorem [U This alternative proof demonstrates 
the kind of difficulties one may face when characterizing representable polymatroids. Finally, 
we will generalize our main result to show that the newly discovered DFZ inequalities are also 
insufficient. 
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Proof: [Alternative proof of Theorem [T| In [8] and [16], all the extreme vectors con(T[A:']) 
are identified for \X\ =4. It can be easily verified that all of the associated rank functions are 
ternary representable. Hence, every vector in con(T[A']) is almost representable. By Theorem 
121 its e-perturbed counterpart is almost representable. 

Now, consider any Ingletonian polymatroid {X, h) and its e-perturbation {X, g) defined as in 
([8]). For any subsets Vi, . . . , V4 C X, h induces a polymatroid (A/4, h') via h'(a) = h(Vj, i G 
a). Clearly, h' is also Ingletonian, since for any subsets ai, . . . , a4 C M^, Jh'(«i, • • • , «4) = 
<^h(VQ,i, . . . , Vcti)- Hence, h' is also almost representable. By Theorem [3l its perturbation is also 
almost representable. 

Now, if h(A') - e > h'(A^4), then clearly 

g(Vi,i e a) = h(Vi,i e a) (53) 

for all a. Then Jg(V„i, . . . , V„J = Jh(V„i, . . . , V^^) > 0. 
On the other hand, suppose that h.{X) — e < h'(A/'4). Then 

giVi, zea) = min(h(Vi, lea), h{X) - e) (54) 

= min(h'(a),h(A')-e) (55) 

= min(h'(a), h'(A4) + h{X) - h'i^^) - e) (56) 

= min(h'(a), h'{Af^) - v) (57) 

where z/ = h'(A/'4) + e - \i{X). Let 

g'(a) ^ min(h'(a),h'(Ar4) - z/). 

Then g' is almost representable and hence J^{Vai-, • • • , Va^) = J^'{oti-, • • • , 014) > 0. ■ 

Theorem 8 (Generalization): Suppose |3^| = n and that all vectors g G con(T[3^]) are almost 
representable. Consider any valid subspace rank inequality of the form 

^ CaH{V,,i e a) > (58) 

where Vj C y. Then for any cc-representable polymatroid {X,h) (i.e., h G con(T[A'])), its 
perturbed counterpart will satisfy the inequality (l58l) . Consequently {X, $") in Section |V] will 



September 19, 2009 



DRAFT 



21 



satisfy (1581) and hence any inequalities involving no more than n subsets are insufficient to 
characterize con(T[A']) in general. 

Proof: The proof is similar to the alternative proof for Theorem [51 ■ 

The newly discovered inequalities [12] were shown to be sufficient to characterize con(T[A']) 
when \X\ < 5. In fact, it was further proved that all the extreme vectors of the cone con(T[A']) 
are g-representable, for sufficiently large q. As a result, every vector in con(T[A']) will be almost 
representable. By Theorem [81 these newly discovered inequalities are insufficient to characterize 
con(T[A']) in general. 

VIL Conclusion 

A complete characterization of representable polymatroids has been open for years. This 
problem is fundamental in nature and is intimately related to the information thoeretic problem 
of the characterization of transmission throughput in networks with linear network coding. Until 
quite recently it was not know whether Ingleton's inequalities are sufficient to characterize all 
representable polymatroids. In this paper, we have constructed an Ingletonian polymatroid that 
satisfies all known (Ingleton and Dougherty-Freiling-Zeger) subspace rank inequalities. As a 
result, there are inequalities remaining to be discovered. While our approach does not suggest 
how to construct these new inequalities, it at least demonstrates some of the difficulties of the 
problem. 
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